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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )E0 Responsive to communication(s) filed on 30 September 2003 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) E3 Claim(s) 1-15 is/are pending in the application. 



Application Papers 

9)D The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 30 September 2003 is/are: a)D accepted or b)[^l objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)[3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
aM AH b)D Some * c)D None of: 

1 Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.Q Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



4a) Of the above claim(s) is/are withdrawn from consideration. 



5) D 

6) H 

7) H 

8) D 



Claim(s) is/are allowed. 

Claim(s) 1-5 and 10-15 is/are rejected. 
Claim(s) 6^9 is/are objected to. 

Claim(s) are subject to restriction and/or election requirement. 
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DETAILED ACTION 
Claim Rejections - 35 USC § 101 

1. 35 U.S.C 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

2. Claims 15 is rejected under 35 U.S.C. 101 because the claimed invention is directed to 
non-statutory subject matter because the invention as claimed does not produce a concrete, and 
tangible result . A process that consists solely of the manipulation of an abstract idea is not 
concrete or tangible. See In re Warmerdam, 33 F.3d 1354, 1360, 31 USPQ2d 1754, 1759 (Fed. 
Cir. 1994). See also Schrader, 22 F.3d at 295, 30 USPQ2d at 1459. For such subject matter to be 
statutory, the claimed process must be limited to a practical application of the abstract idea or 
mathematical algorithm in the technological arts. See Alappat, 33 F.3d at 1543, 31 USPQ2d at 
1556-57. In determining whether the claim is for a "practical application," the focus is not on . 
whether the steps taken to achieve a particular result are useful, tangible and concrete, but rather 
that the final result achieved by the claimed invention is "useful, tangible and concrete." (see also 
MPEP§2106). 

Furthermore, Data structures not claimed as embodied in computer-readable media are 
descriptive material per se and are not statutory because they are not capable of causing 
functional change in the computer. See, e.g., Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 1760 
(claim to a data structure per se held nonstatutory). Such claimed data structures do not define 
any structural and functional interrelationships between the data structure and other claimed 
aspects of the invention which permit the data structure's functionality to be realized. In contrast, 
a claimed computer-readable medium encoded with a data structure defines structural and 
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functional interrelationships between the data structure and the computer software and hardware 
components which permit the data structure's functionality to be realized, and is thus statutory. 

Similarly, computer programs claimed as computer listings per se, i.e., the descriptions or 
expressions of the programs, are not physical "things." They are neither computer components 
nor statutory processes, as they are not "acts" being performed. Such claimed computer 
programs do not define any structural and functional interrelationships between the computer 
program and other claimed elements of a computer which permit the computer program's 
functionality to be realized. In contrast, a claimed computer-readable medium encoded with a 
computer program is a computer element which defines structural and functional 
interrelationships between the computer program and the rest of the computer which permit the 
computer program's functionality to be realized, and is thus statutory. See Lowry, 32 F.3d at 
1583-84, 32 USPQ2d at 1035. Accordingly, it is important to distinguish claims that define 
descriptive material per se from claims that define statutory inventions. 

Computer programs are often recited as part of a claim. USPTO personnel should determine 
whether the computer program is being claimed as part of an otherwise statutory manufacture or 
machine. In such a case, the claim remains statutory irrespective of the fact that a computer 
program is included in the claim. The same result occurs when a computer program is used in a 
computerized process where the computer executes the instructions set forth in the computer 
program. Only when the claimed invention taken as a whole is directed to a mere program 
listing, i.e., to only its description or expression, is it descriptive material per se and hence 
nonstatutory. Since a computer program is merely a set of instructions capable of being executed 
by a computer, the computer program itself is not a process and USPTO personnel should treat a 
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claim for a computer program, without the computer-readable medium needed to realize the 
computer program's functionality, as nonstatutory functional descriptive material. When a 
computer program is claimed in a process where the computer is executing the computer 
program's instructions, USPTO personnel should treat the claim as a process claim. See 
paragraph IV.B.2(b), below. When a computer program is recited in conjunction with a physical 
structure, such as a computer memory, USPTO personnel should treat the claim as a product 
claim. See paragraph IV.B.2(a), below. 



Claim Rejections - 35 USC § 112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

3. Claim 15 rejected under 35 U.S.C. 1 12, second paragraph, as being indefinite in that it 
fails to point out what is included or excluded by the claim language. This claim is an omnibus 
type claim. In the instant case, it not clear that the claim 15 related to a apparatus, i.e. computer 
readable medium; a program (or code) for detecting the line of sight. . . determining a display 
region. . . and compositing the other image. ... In addition, how a program comprising a code . . . 
said code comprising other three codes as recites in claim 15. 

4. The following is a quotation of the first paragraph of 35 U.S.C. 1 12: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 

5. Claim 1 1 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply with the 
written description requirement. The claim(s) contains subject matter which was not described 
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in the specification in such a way as to reasonably convey to one skilled in the relevant art that 
the inventor(s), at the time the application was filed, had possession of the claimed invention. 
There is no support for the claimed limitation "the information that helps the operation of the 
user is an image obtained by taking image of an action of the user". 

Drawings 

6. The drawings are objected to under 37 CFR 1.83(a). The drawings must show every 
feature of the invention specified in the claims. Therefore, "the information that helps the 
operation of the user is an image obtained by taking image of an action of the user" must be 
shown or the feature(s) canceled from the claim(s). No new matter should be entered. 

Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in reply to 
the Office action to avoid abandonment of the application. Any amended replacement drawing 
sheet should include all of the figures appearing on the immediate prior version of the sheet, 
even if only one figure is being amended. The figure or figure number of an amended drawing 
should not be labeled as "amended." If a drawing figure is to be canceled, the appropriate figure 
must be removed from the replacement sheet, and where necessary, the remaining figures must 
be renumbered and appropriate changes made to the brief description of the several views of the 
drawings for consistency. Additional replacement sheets may be necessary to show the 
renumbering of the remaining figures. Each drawing sheet submitted after the filing date of an 
application must be labeled in the top margin as either "Replacement Sheet" or "New Sheet" 
pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, the applicant will 
be notified and informed of any required corrective action in the next Office action. The 
objection to the drawings will not be held in abeyance. 



■1 



Application/Control Number: 10/658,335 . Page 6 

Art Unit: 2629 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

8. Claims 1-5 and 10-15 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Lemelson et al. (U.S Patent No 6,847,336), hereinafter Lemelson. 

In reference to claim 1, Lemelson discloses an image composition system (Figs 1-3) for 
compositing a real image in a line-of-sight direction of a user (image of the patient in Fig. 6) 
' with another image (cursor 40), comprising: 

a display unit (14) which is wearable on a head of the user (12 in Fig.2), and displays a 
composite image; 

a position sensor (47) for detecting the line-of-sight direction of the user, and outputting 
line-of-sight information (see Fig. 4); 

a determination (36 in Fig. 3) unit for determining a display region where the other 
image is to be displayed, in accordance with the line-of-sight information; and 

a composition unit (36) for compositing the other image on the determined display 
region, wherein the other image is used to display information that helps operations of the user 
(the cursor is help the user to select items on the display; see Fig. 6-7). 

In reference to claim 2, Lemelson discloses display unit has an optical see-through 
structure, and the user can observe a real space via said display unit (col. 10, lines 26-35). 



Application/Control Number: 10/658,335 Page 7 

Art Unit: 2629 

In reference to claim 3, Lemelson discloses first image taking device (camera 29; Fig. 1) 
for obtaining a video of a real space observed from a viewpoint of the user, and wherein said 
composition unit displays the video obtained by said first image taking device on said display 
unit, and superimposes the other image on the display region determined by said determination 
unit (col. 9, lines 35-45). 

In reference to claim 4, Lemelson discloses the other image information is a video 
obtained by a second image taking device (38 in Fig. 6)for taking an image from a viewpoint 
other than a viewpoint of the user. 

In reference to claim 5, Lemelson discloses wherein the other image information is 
text information (see Fig. 6). 

In reference to claim 10, Lemelson discloses (col.. 11, lines 4-10) the information that 
helps the operations of the user is dialog information. 

In reference to claim 11, Lemelson discloses the information that helps the operations of 
the user is an image obtained by taking an image of an action of the user (the image sensor 
system 47 taking image of the user action, i.e. moving eyes, to move the cursor on display 14). 

Claim 12-15 are method and computer readable medium associated with the above 
apparatus claims; therefore, are rejected as the same rejections as set forth above. 

Allowable Subject Matter 
9. Claims 6-9 are objected to as being dependent upon a rejected base claim, but would be 
allowable if rewritten in independent form including all of the limitations of the base claim and 
any intervening claims. 
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10. The following is a statement of reasons for the indication of allowable subject matter: 
none of the cited arts teaches or suggests: 

"The system according to claim 5, further comprising: a memory for holding a pair of the 
text information and time information indicating a display timing of the text information, and 
wherein said composition unit switches the text information to be displayed on the display region 
in accordance with the time information held by said memory". 

"The system according to claim 1, wherein said determination unit comprises: a setting 
unit for setting a space region for displaying the other image in the real space; and a conversion 
unit for converting the space region set by said setting unit into the display region on said display 
unit on the basis of a position and posture of the user." 

The system according to claim 1, further comprising: a gesture detection unit capable of 
detecting a predetermined action of the user, and wherein said composition unit controls to turn 
on/off display of the other image in response to a predetermined action detected by said gesture 
detection unit." 



Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DUC Q DESfH whose telephone number is (571) 272-7686. 
examiner can normally be reached on Mon-Fri from 8:00.AM-4:00.PM. 



The 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richard Hjerpe can be reached on (571) 272-769 1. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



DUC Q DINH 
Examiner 
Art Unit 2629 




DQD 

December 19, 2006 



